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DETAILED ACTION 
Priority 

1 . Acknowledgment is made of applicant's claim for foreign priority under 35 
U.S.C. 1 19(a)-(d). The certified copy has been filed in the pending application. 

Claim Rejections - 35 USC § 103 
The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all obviousness 
rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

2. Claims 1, 4-7 and 10 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Prandoni et al. (U.S. Patent 7,042,493) in view of Meier et al. (U.S. Patent 7,075,556). 

In reference to claim 1, Prandoni et al. discloses a video processing apparatus (see 
column 1, lines 44-58 and Figure 1) of a telecommunications system comprising: 

a video input section to which a video data comprising a plurality of frame images is 
input (see column 2, lines 9-14 and #101 and "video" of Figure #1 wherein Prandoni et al. 
discloses the apparatus to comprise of a background-foreground extraction module which 
receives a video sequence. The Examiner interprets the background-foreground extraction 
module equivalent to the video input section since data as described in the claims is received by 
this module of Prandoni et al.) 

a drawing input section to which a drawn input image is input; 
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an image control section that periodically cuts out a selected image in real time as static 
image information from the frame images at intervals of predetermined time (see column 2, lines 
9-14, 47-62, columns 2-3, lines 63-14 and column 5, lines 8-15 wherein Prandoni et al. discloses 
the apparatus to comprise of a background-foreground extraction module which receives a video 
sequence, say from a standard camera, and extracts one or several foreground features to appear 
in stroboscoping sequence. Prandoni et al. further discloses such extraction to occur based upon a 
number of "triggered" events one being frame-based triggering another being time-based 
triggering where foreground features are extracted at fixed time intervals, say every t seconds or 
as per user-defined triggering events. Lastly, Prandoni explicitly discloses the invention 
extended to on-demand video delivery systems and also sporting events both of which the 
Examiner interprets as providing the "real-time" environment for which the invention of 
Prandoni is disclosed as extended thereto.) and periodically extracts the drawn input image as 
input drawing static information at intervals of the predetermined time; 

an image information storage section that stores the static image information (see column 
5, lines 20-23 wherein Prandoni et al. claims a computer performing the methods of the 
invention. Note, the Examiner interprets the computer of Prandoni et al. to inherently comprise 
of some sort of memory for storing, at least temporarily, the foreground/background extracted 
images/objects since Prandoni et al. discloses explicit manipulation of such information which 
would require at least temporary storage of the data.) and the input drawing static information; 

an image combining section that combines the static image information and the input 
drawing static information to create combined image information (see column 3, lines 15-41 and 
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Figure 1 wherein Prandoni et al. discloses a synthesis module that combines selected foreground 
features and background visual information into a composite image); and 

an image drawing section that outputs the combined image information (see columns 3-4, 
lines 42-14 and Figure 1 wherein Prandoni et al. discloses a rendering module that in some 
instances, produces/outputs a video sequence of composite images) and; 

a display section that display the combined image information (see column 2, lines 38-42 
and #130 of Figure 1 wherein Prandoni et al. discloses a rendering module transforming data 
suitable for display on a video device), 

wherein the predetermined time is set to be greater than or equal to a processing time of 
the drawing processing apparatus, said processing time being a duration starting from a time 
when the selected image is cut out to a time when the combined image information is displayed 
on the display section (see column 3, lines 3-4, 1 1-13 and 62-67 wherein Prandoni et al. 
discloses extraction to occur based upon a number of "triggered" events one being frame-based 
triggering another being time-based triggering and another being user-defined where foreground 
features are extracted at fixed time intervals, say every t seconds and as per a user's involvement 
clicking on image frames. Prandoni et al. further discloses the video sequence being rendered 
when the triggering events are reached. Therefore, the Examiner interprets the above mentioned 
per frame triggered extraction techniques of Prandoni et al. at least equal to the time from when 
an image is selected via the frame-defined trigger event to the time that a composite image is 
rendered/displayed. Further, the Examiner states that such a timing as recited by Applicant's 
claim is inherent to the timing of Prandoni et al. since it is inherent that video sequence data is 
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displayed at x frames per second and therefore, the time between when extraction is performed 
for a frame and when combined information is displayed is predetermined.) and 

wherein said telecommunications system includes a plurality of participant terminals. 

Prandoni et al. does not explicitly disclose extracting input drawing static information 
from a drawn input image every predetermined time. Meier et al. discloses a system for 
annotating video or still images wherein a user utilizing a telestrator to draw upon video images 
and to combine the drawn and video images for broadcasted display (see column 1, lines 23-24, 
column 3, lines 60-63, columns 4-5, lines 51-4). Meier et al. explicitly discloses a telestration 
processor receiving an input from a touch screen or pen/stylus for a drawing upon the screen (see 
column 4, lines 51-60 and column 12, lines 41-44). Meier et al. discloses the telestration 
processor outputting such pixel data along with time code data associating such pixel data with 
specific frames/fields to a rendering processor which processes such data on a frame by frame 
basis (see columns 15-16, lines 58-2 and Figure 1 1). Note, the Examiner interprets such reading 
of data from the touch screen/pen/stylus input via the telestration processor, marking such data 
with specific time code data, more specifically the time code data being in units of frames/fields, 
equivalent to Applicant's periodically extracting the drawing input at intervals of a 
predetermined time (as indicated by the associated time code in Meier et al.). Further, since 
Meier et al. discloses the invention directed towards the field of telestration in a television 
system for, say a televised football game (see columns 1-2), the Examiner interprets the 
invention to be directed towards the field of telecommunications including a plurality of 
participant terminals (television viewers). Lastly, note the Examiner believes Meier et al. to be 
directly applicable to Prandoni et al.'s field of invention and further believes the two invention to 



Application/Control Number: 10/829,276 Page 6 

Art Unit: 2628 

be able to function correctly since they are both based upon extraction/processing of data on a 
frame -by- frame basis. It would have been obvious to one of ordinary skill in the art at the time 
the invention was made to implement the telestration system including touch screen/pen/stylus 
and video based image processing techniques of Meier et al. with the foreground/background 
image data processing techniques of Prandoni et al. in order to allow the viewing of real-time 
user interaction data along with video captured data on a display simultaneously allowing for 
multiple viewers/users of the system to better graphically articulate information to one another 
that is explicit to the captured video (see column 1, lines 40-54 and column 2, lines 30-32 and 
56-63 of Meier et al). (see Response to Arguments below) 

In reference to claim 4, Prandoni et al. and Meier et al. disclose all of the claim 
limitations as applied to claim 1 above. Prandoni et al. discloses the apparatus to comprise of a 
background-foreground extraction module which receives a video sequence, say from a standard 
camera, and extracts one or several foreground features to appear in stroboscoping sequence (see 
column 2, lines 9-14, 47-62 and columns 2-3, lines 63-14). Prandoni et al. discloses a rendering 
module that in some instances, produces/outputs a video sequence of composited images (see 
columns 3-4, lines 42-14 and Figure 1), the rendering module seen as providing equivalent 
functionality as Applicant's moving image reproducing section. Prandoni et al. claims a 
computer performing the methods of the invention (see column 5, lines 20-23). Note, the 
Examiner interprets the computer of Prandoni et al. to inherently comprise of some sort of 
memory or moving image storage section for storing, at least temporarily, the rendered/output 
video stroboscoped sequences. 
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In reference to claim 5, Prandoni et al. and Meier et al. disclose all of the claim 
limitations as applied to claim 1 above. Prandoni et al. discloses the apparatus to comprise of a 
background- foreground extraction module which receives a video sequence, say from a standard 
camera, and extracts one or several foreground features to appear in stroboscoping sequence (see 
column 2, lines 9-14, 47-62 and columns 2-3, lines 63-14). Prandoni et al. discloses a rendering 
module that in some instances, produces/outputs a video sequence of composited images (see 
columns 3-4, lines 42-14 and Figure 1). Meier et al. discloses allowing the user to create a 
drawing defined by polygons, alpha values, color values, texture values and fill characteristics 
(see columns 15-16, liens 58-1) and in one particular embodiment, details the user drawing a 
arrow/line which the Examiner interprets as inherently equivalent to vector data (see Figures 1-4 
and column 12, lines 41-43). Meier et al. also discloses combining such drawing input with 
video frame data capture from cameras (see columns 15-16, lines 58-8 and Figures 11-12). It 
would have been obvious to one of ordinary skill in the art at the time the invention was made to 
implement the telestration system including touch screen/pen/stylus and video based image 
processing techniques of Meier et al. with the foreground/background image data processing 
techniques of Prandoni et al. in order to allow the viewing of real-time user interaction data 
along with video captured data on a display simultaneously allowing for multiple viewers/users 
of the system to better graphically articulate information to one another that is explicit to the 
captured video (see column 1, lines 40-54 and column 2, lines 30-32 and 56-63 of Meier et al). 

In reference to claim 6, Prandoni et al. and Meier et al. disclose all of the claim 
limitations as applied to claim 5 above. Meier et al. discloses the drawing data to include pixel 
coordinates for the drawn polygons, color data, tessellations per quadrilateral (number of 
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subdivides), texture data and fill characteristics for the polygons (see columns 15-16, lines 65-2) 
which the Examiner interprets equivalent to Applicant's drawing data. 

In reference to claim 7, claim 7 is equivalent in scope to claim 1 and is therefore rejected 
under similar rationale. Further, it is noted that claim 7 recites a method type claim, the steps of 
the method as claimed are disclosed by the above recited teachings of the combination of 
Prandoni et al. and Meier et al. 

In reference to claim 10, claim 10 is equivalent in scope to claim 1 and is therefore 
rejected under similar rationale. Further, it is noted that claim 10 recites a computer-readable 
medium/program type claim, the steps of the program executed by the computer as claimed are 
disclosed by the above recited teachings of the combination of Prandoni et al. and Meier et al. 
Prandoni et al. claims a computer performing the methods of the invention (see column 5, lines 
20-23). Note, the Examiner interprets the computer of Prandoni et al. to inherently comprise of 
some type of memory or medium for storing instructions/programs to execute or perform tasks. 
3. Claims 3 and 9 are rejected under 35 U.S.C. 103(a) as being unpatentable over Prandoni 
et al. (U.S. Patent 7,042,493), Meier et al. (U.S. Patent 7,075,556) and further in view of 
Seedholm, Peter. "Print Screen Button Tutorial." 
(http://www.ibiblio.org/virtualcell/Tutorl/TandR/prtscr.html). 

In reference to claims 3 and 9, Prandoni et al. and Meier et al. disclose all of the claim 
limitations as applied to claims 1 and 7 respectively above. Prandoni et al. claims a computer 
performing the methods of the invention (see column 5, lines 20-23) which the Examiner 
interprets as inherently comprising a keyboard providing some sort of input to the invention. 
Neither Prandoni et al. nor Meier et al. explicitly disclose the image drawing section having a 
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function of capturing the combined image using a screen capture signal by an image capture 
operation of a user. Seedholm discloses a tutorial for capturing and pasting a displayed screen of 
data using the print screen button on a keyboard (see steps 1-6 of Seedholm). It would have been 
obvious to one of ordinary skill in the art at the time the invention was made to implement the 
print screen display screen capturing techniques of Seedholm with the telestration system of 
Meier et al. and foreground/background image data processing techniques of Prandoni et al. in 
order to capture the current displayed image on a display monitor and further process the image 
by i.e. pasting it into another program/application, transmitting it over a network medium, saving 
it to a computer medium etc. 

4. Claim 1 1 is rejected under 35 U.S.C. 103(a) as being unpatentable over Prandoni et al. 
(U.S. Patent 7,042,493), Meier et al. (U.S. Patent 7,075,556) and further in view of Dempski et 
al. (U.S. Pub 20040155902). 

In reference to claim 11, Prandoni et al. discloses a video processing apparatus (see 
column 1, lines 44-58 and Figure 1) teleconference system in which a plurality of participant 
terminals which participate in a conference are connected through a communication line, 
wherein a drawing processing apparatus comprises: 

a video input section to which a video data comprising a plurality of frame images is 
input (see column 2, lines 9-14 and #101 and "video" of Figure #1 wherein Prandoni et al. 
discloses the apparatus to comprise of a background-foreground extraction module which 
receives a video sequence. The Examiner interprets the background-foreground extraction 
module equivalent to the video input section since data as described in the claims is received by 
this module of Prandoni et al.) 



Application/Control Number: 10/829,276 Page 10 

Art Unit: 2628 

a drawing input section to which a drawn input image is input; 

an image control section that periodically cuts out a selected image in real time as static 
image information from the frame images at intervals of predetermined time (see column 2, lines 
9-14, 47-62, columns 2-3, lines 63-14 and column 5, lines 8-15 wherein Prandoni et al. discloses 
the apparatus to comprise of a background-foreground extraction module which receives a video 
sequence, say from a standard camera, and extracts one or several foreground features to appear 
in stroboscoping sequence. Prandoni et al. further discloses such extraction to occur based upon a 
number of "triggered" events one being frame-based triggering another being time-based 
triggering where foreground features are extracted at fixed time intervals, say every t seconds or 
as per user-defined triggering events. Lastly, Prandoni explicitly discloses the invention 
extended to on-demand video delivery systems and also sporting events both of which the 
Examiner interprets as providing the "real-time" environment for which the invention of 
Prandoni is disclosed as extended thereto.) and periodically extracts the drawn input image as 
input drawing static information at intervals of the predetermined time; 

an image information storage section that stores the static image information (see column 
5, lines 20-23 wherein Prandoni et al. claims a computer performing the methods of the 
invention. Note, the Examiner interprets the computer of Prandoni et al. to inherently comprise 
of some sort of memory for storing, at least temporarily, the foreground/background extracted 
images/objects since Prandoni et al. discloses explicit manipulation of such information which 
would require at least temporary storage of the data.) and the input drawing static information; 

an image combining section that combines the static image information and the input 
drawing static information to create combined image information (see column 3, lines 15-41 and 
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Figure 1 wherein Prandoni et al. discloses a synthesis module that combines selected foreground 
features and background visual information into a composite image); and 

an image drawing section that outputs the combined image information (see columns 3-4, 
lines 42-14 and Figure 1 wherein Prandoni et al. discloses a rendering module that in some 
instances, produces/outputs a video sequence of composite images) and; 

a display section that display the combined image information (see column 2, lines 38-42 
and #130 of Figure 1 wherein Prandoni et al. discloses a rendering module transforming data 
suitable for display on a video device), 

wherein the predetermined time is set to be greater than or equal to a processing time of 
the drawing processing apparatus, said processing time being a duration starting from a time 
when the selected image is cut out to a time when the combined image information is displayed 
on the display section (see column 3, lines 3-4, 1 1-13 and 62-67 wherein Prandoni et al. 
discloses extraction to occur based upon a number of "triggered" events one being frame-based 
triggering another being, another being time-based triggering and another being user-defined 
where foreground features are extracted at fixed time intervals, say every t seconds and as per a 
user's involvement clicking on image frames. Prandoni et al. further discloses the video 
sequence being rendered when the triggering events are reached. Prandoni et al. further discloses 
the video sequence being rendered when the triggering events are reached. Therefore, the 
Examiner interprets the above mentioned per frame triggered extraction techniques of Prandoni 
et al. at least equal to the time from when an image is selected via the frame-defined trigger 
event to the time that a composite image is rendered/displayed. Further, the Examiner states that 
such a timing as recited by Applicant's claim is inherent to the timing of Prandoni et al. since it 
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is inherent that video sequence data is displayed at x frames per second and therefore, the time 
between when extraction is performed for a frame and when combined information is displayed 
is predetermined.). 

Prandoni et al. does not explicitly disclose extracting input drawing static information 
from a drawn input image every predetermined time. Meier et al. discloses a system for 
annotating video or still images wherein a user utilizing a telestrator to draw upon video images 
and to combine the drawn and video images for broadcasted display (see column 1, lines 23-24, 
column 3, lines 60-63, columns 4-5, lines 51-4). Meier et al. explicitly discloses a telestration 
processor receiving an input from a touch screen or pen/stylus for a drawing upon the screen (see 
column 4, lines 51-60 and column 12, lines 41-44). Meier et al. discloses the telestration 
processor outputting such pixel data along with time code data associating such pixel data with 
specific frames/fields to a rendering processor which processes such data on a frame by frame 
basis (see columns 15-16, lines 58-2 and Figure 1 1). Note, the Examiner interprets such reading 
of data from the touch screen/pen/stylus input via the telestration processor, marking such data 
with specific time code data, more specifically the time code data being in units of frames/fields, 
equivalent to Applicant's periodically extracting the drawing input at intervals of a 
predetermined time (as indicated by the associated time code in Meier et al.). Further, since 
Meier et al. discloses the invention directed towards the field of telestration in a television 
system for, say a televised football game (see columns 1-2), the Examiner interprets the 
invention to be directed towards the field of telecommunications including a plurality of 
participant terminals (television viewers). Lastly, note the Examiner believes Meier et al. to be 
directly applicable to Prandoni et al.'s field of invention and further believes the two invention to 
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be able to function correctly since they are both based upon extraction/processing of data on a 
frame -by- frame basis. It would have been obvious to one of ordinary skill in the art at the time 
the invention was made to implement the telestration system including touch screen/pen/stylus 
and video based image processing techniques of Meier et al. with the foreground/background 
image data processing techniques of Prandoni et al. in order to allow the viewing of real-time 
user interaction data along with video captured data on a display simultaneously allowing for 
multiple viewers/users of the system to better graphically articulate information to one another 
that is explicit to the captured video (see column 1, lines 40-54 and column 2, lines 30-32 and 
56-63 of Meier et al). Although Meier et al. does disclose such telestration techniques used in a 
telecommunications environment, neither Prandoni et al. nor Meier et al. explicitly disclose their 
image data processing techniques within a specific teleconferencing environment however 
Dempski et al. does. Dempski et al. discloses a computer system in a teleconferencing 
environment for superimposing a computer-generated image onto a video image or vice versa 
(see paragraphs 5 and 1 1 of Dempski et al.). It would have been obvious to one of ordinary skill 
in the art at the time the invention was made to implement the teleconference superimposing 
techniques of Dempski et al. with the telestration system including touch screen/pen/stylus and 
video based image processing techniques of Meier et al. and foreground/background image data 
processing techniques of Prandoni et al. in order to allow multiple users to view, manipulate, and 
share real-time data in a teleconferencing environment making it easier to communicate to users 
in remote locations (see paragraphs 2-3 of Dempski et al.). 



Response to Arguments 
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5. Applicant's arguments, see page 7 of Applicant's Remarks, filed 06/19/09, with respect 
to the 35 USC 101 rejection of claims 7 and 9 have been fully considered and are persuasive. 
The 35 USC 101 rejection of these claims has been withdrawn since the amendments to these 
claims now recite at least one step of the body of the method type claims as tied to another 
statutory category that accomplishes the claimed step. 

6. Applicant's arguments filed 06/19/09 have been fully considered but they are not 
persuasive. 

In reference to the claims, Applicant argues the 35 USC 103 rejection in view of 
Prandoni and Meier, in particular that Prandoni is directed to stroboscoping sequences in "non- 
real-time" while Meier is directed to "real-time" annotating of video and therefore one of 
ordinary skill in the art would not have been led to combine the references (see 1 st paragraph of 
page 8 of Applicant's Remarks). 

In response, the Examiner disagrees. Prandoni explicitly discloses the invention 
extended to on-demand video delivery systems and also sporting events (see column 5, lines 8- 
15) both of which the Examiner interprets as providing the "real-time" environment for which 
the invention of Prandoni is disclosed as extended thereto. For example, in the traditional "on- 
demand" system, a user in "real-time" selects a video for viewing of which processing can be 
applied thereto upon selection of that video. Therefore, one of ordinary skill in the art would be 
motivated to combine the two cited references not only because they are both targeted for use in 
equivalent environments but also since they are both directed to the processing of video data in 
the manner of extracting/processing video data on a frame-by-frame basis. For at least this 
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reason, the Examiner believes the interpretation and combination of Prandoni and Meier to be 
just and maintains such a rejection. 

Further, Applicant argues that even the combination of the invention does not arrive at 
what is claimed (see 2 nd paragraph, page 8 of Applicant's Remarks). 

In response, the Examiner disagrees and points to the above rejection and rationale from 
which, the claim limitations are each explained as disclosed by either Prandoni, Meier or their 
combination. Therefore, the Examiner maintains the rejection based upon Prandoni and Meier. 

Conclusion 

Applicant's amendment necessitated the new ground(s) of rejection presented in this 
Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). 
Applicant is reminded of the extension of time policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1 .136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the date of this 
final action. 
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Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Antonio Caschera whose telephone number is (571) 272-778 1 . 
The examiner can normally be reached Monday-Friday between 7:00 AM and 3:30 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Kee Tung, can be reached at (571) 272-7794. 

Any response to this action should be mailed to: 

Commissioner of Patents and Trademarks 
Washington, D.C. 20231 

or faxed to: 

571-273-8300 (Central Fax) 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the Technology Center 2600 Customer Service Office whose telephone 
number is (571)272-2600. 



/Antonio A Caschera/ 

Primary Examiner, Art Unit 2628 

10/19/09 



